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(54) Image processing apparatus and method therefor 



(57) In order to faithfully reproduce a desired color 
in the output condition of an output device, there are con- 
ducted steps of entering information on the output con- 
dition of the predetermined output device, and mapping 
the color image data within the color reproduction range 
reproducible by the predetermined output device under 
the entered output condition. 




BNSDOCID: <EP _0706285A2_I_> 



Printed by Jouve (FR), 16, rue Saint-Denis, 75001 PARIS 



EP 0 706 285 A2 



Description 

BACKGROUND OF THE INVENTION 
Field of the invention 

The present invention relates to an image process- 
ing apparatus capable of color conversion of color image 
data so as to achieve faithful reproduction in an image 
recording device, and a method therefor. 

Related Background Art 

In case of printing texts, computer graphics or imag- 
es, prepared by the operator in an application task on a 
host equipment, by a recording device such as an ink jet 
printer, there have been devised various methods for ex- 
actly reproducing the color desired by the operator on 
the recording device. 

In certain systems there is employed, for example, 
a method of setting profile data, representing the char- 
acteristics of input and output devices, corresponding to 
the input and output devices of the system and convert- 
ing the R, G and B values defined in the color space of 
the input device into the C, M, Y and K values of the color 
space of the output device by reading thus set profiles 
of the input and output devices, thereby reproducing the 
color, desired by the operator on the input device, exactly 
on the output device, or returning these values to the R, 
G and B values ol the color space of the input device for 
preview on a monitor. 

In such method, however, there can be selected only 
one profile for each input or output device. However, for 
example, in a binary recording device in which recording 
is determined by forming each dot or not, as in the ink 
jet recording device, the color reproduction range or the 
output rendition characteristics may vary even for a 
same output device, by the binarizing method for the im- 
age data containing tonal rendition, such as the dither 
method or the error diffusion method. Besides such var- 
iation in the color reproduction range or the output ren- 
dition characteristics may occur even for a same bina- 
rizing method on different recording medium such as 
coated paper and plain paper. Furthermore, in case of 
faithfully reproducing the image, displayed on the moni- 
tor, in the recording device, said image even on a same 
monitor may vary by the adjustable values thereof such 
as the gamma value and the white point. Consequently, 
even when the input and output devices are fixed, the 
exact reproduction of the desired color cannot be 
achieved by a set of profile data is there is a variation in 
the binarizing method, recording medium or adjustable 
values. 

Also in certain applications, there is conventionally 
adopted a method of registering in advance colors repro- 
ducible on a specified recording device by the mixing ra- 
tios of elementary colors, for example C = 20%, M = 50%, 
Y = 30% and K = 0% for a sample color No. 1 , and ef- 
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fecting designation of a color by the number of such sam- 
ple color while referring to the sample colors printed in 
advance by said specified recording device. 

In such method, however, the color samples only 
5 contain the C. M, Y and K values while exact colors are 
not reproduced on the monitor of the host equipment 
where the work of the operator is conducted. 

SUMMARY OF THE INVENTION 

10 

In consideration ol the foregoing, a concern of the 
present invention is to faithfully reproduce the desired 
color under the output conditions of predetermined out- 
put means. 

is Another concern of the present invention is to pre- 
cisely judge whether the input image data are within the 
color reproduction range. 

Still another concern of the present invention is to 
enable faithful reproduction, by image recording means, 
20 of the color represented by the input color image data 
dependent on certain device. 

Still another concern of the present invention is to 
enable faithful reproduction, by the image recording de- 
vice: of the color designated by color designating infor- 
ms mation. 

According to the present invention, there is provided 
an image processing method comprising the steps of: 

entering information concerning signal processing 
condition in predetermined output means; and 
30 mapping color image data in a color reproduction 

range which can be reproduced by said predetermined 
output means under said entered signal processing con- 
dition. 

An embodiment of the present invention provides an 
35 image processing method adapted to judge whether in- 
put image data are within the color reproduction range 
of predetermined output means, wherein said judgement 
is based on the color reproduction range corresponding 
to the output condition of said predetermined output 
40 means. 

Another aspect of the present invention provides an 
image processing apparatus comprising: 

first input means for entering color image data de- 
pendent on the characteristics of a predetermined de- 

45 vice; 

first memory means for storing input profile data 
representing the characteristics of said predetermined 
device; 

second memory means for storing output profile 
so data representing characteristics under an output condi- 
tion of predetermined image recording means; 

second input means for entering information rep- 
resenting output condition of said image recording 
means; and 

55 color space conversion means for effecting color 

space conversion on the color image data entered by 
said first input means, based on said input profile data 
and the output profile data corresponding to the output 
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condition of said image recording means, entered by 
said second input means and stored in said second 
memory means. 

A further aspect of the present invention provides an 
image processing apparatus provided with: 

input means for entering color designating informa- 
tion; 

first memory means lor storing color data; 

second memory means for storing data represent- 
ing characteristics of display means; and 

third memory means for storing characteristics of 
recording means for recording an image on a recording 
medium; said apparatus comprising: 

read-out means for reading color data correspond- 
ing to said color designating information entered by said 
input means; 

color space conversion means tor effecting color 
space conversion on the color data read by said read-out 
means, into color data matching the characteristics of 
said recording means, based the data in said second 
memory means representing the display characteristics 
and the data in said third memory means representing 
the characteristics of the recording means; and 

output means for sending the color data, subjected 
to the color space conversion by said color space con- 
version means to said recording means. 

Advantages of the present invention, and the fea- 
tures thereof, will become fully apparent from the follow- 
ing detailed description, which is to be taken in conjunc- 
tion with the attached drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram of a system constituting a 
first embodiment of the present invention; 

Fig. 2 is a block diagram of an image processing 
apparatus constituting the 1st embodiment; 

Fig. 3 is a flow chart showing an example of color 
space conversion process; 

Fig. 4 is a flow chart showing an example of calcu- 
lation of color reproduction range; 

Fig. 5 is a block diagram of a variation 1 of the image 
processing apparatus of the 1 st embodiment; 

Fig. 6 is a block diagram of a variation 2 of the image 
processing apparatus of the 1st embodiment; 

Fig. 7 is a block diagram of a variation 3 of the image 
processing apparatus of the 1st embodiment; 

Fig. 8 is a block diagram of a variation 4 of the image 
processing apparatus of the 1st embodiment; 

Fig. 9 is a block diagram ol an image processing 



apparatus constituting a 2nd embodiment of the 
present invention; 

Fig. 10 is a block diagram of a variation 1 of the 
5 image processing apparatus of the 2nd embodi- 
ment; and 

Fig. 11 is a block diagram of a variation 2 of the 
image processing apparatus of the 2nd embodi- 
10 ment; 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

is Now the present invention will be clarified in detail 
by preferred embodiments thereof, with reference to the 
attached drawings. 

Fig. 1 shows an example of the system of the 
present invention, designed for reproducing an image, 

20 prepared by the operator on a host equipment utilizing a 
displayed image on a monitor 10, by a printer 11 such as 
an ink jet recording device, and said system is composed 
of a host equipment 100 and a monitor 1 0 and a record- 
ing device 14 connected thereto. 

25 However the present invention is not limited to the 
system mentioned above but is likewise realizable in an- 
other system provided further with other devices for ex- 
ample an image input device such as a scanner and an 
external memory device for storing image data. 

30 Also the connected recording device is not limited to 
a printer but can be another device such as a color cop- 
ying device. 

[1st embodiment] 

35 

Fig. 2 is a block diagram showing an image process- 
ing system constituting a 1st embodiment of the present 
invention. 

Color reproduction range calculation means 1 cal- 

40 culates whether the input R, G, B values, dependent on 
an input device, are reproducible in the output device, 
utilizing input and output profiles read by input and output 
profile setting/reading means 3, 5 to be explained later. 
Color space conversion means 2 effects conversion 

45 of the input device-dependent R, G, B values into Y, M, 
C, K values to be used in and dependent on the printer 
11 constituting the output device currently connected to 
the system, utilizing the input and output profiles read by 
the input and output profile setting/reading means 3, 5. 

50 Setting means 12 sets the kind of the monitor 10 
connected to the host equipment 1 00 as shown in Fig. 1 . 

Input profile setting/reading means 3 sets and reads 
the input profile, according to the kind of monitor set by 
the monitor setting means. 

55 Input profile memory means 4 stores the input profile 
representing the device characteristics of the monitor 
connected to the present system, and said profile data 
contain color coordinates of a white point and red, green 
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and blue primary colors for defining the monitor-depend- 
ent RGB space, and response curves for different colors 
representing the monitor characteristics. 

Printer condition setting means 9 is to set various 
output conditions of the connected printer, or the param- 
eters relating to the color process defined therein, and 
contains printer kind setting means 8 for setting the kind 
of the connected printer and binarization method setting 
means 6 for setting the binarizing method to be em- 
ployed in said printer 

Said binarizing method can be, for example dither 
method, error diffusion method or density pattern meth- 
od. The inkjet recording device can reproduce the image 
only in binary manner, namely whether or not to deposit 
ink for each pixel. Said binarizing method is employed in 
order to reproduce the image by the binary data, as close 
as possible to the original image represented by mul- 
ti-value data and including intermediate tones. Each bi- 
narizing method has its features, and the characteristics 
of the output device, such as the color reproduction 
range thereof, naturally vary depending on the binarizing 
method. 

The above-mentioned bither method is disclosed for 
example in the Japanese Patent Application No. 
58-80085. Also the error diffusion method and the den- 
sity pattern method are for example disclosed respec- 
tively in the Japanese Patent Application No. 1-229786 
and No. 57-56964. 

In the following there will be explained features of 
the dither method and the error diffusion method. 

The dither method is fast in the processing speed 
but inferior in the tonal rendition, and the color reproduc- 
tion range is narrow because of such inferior tonal ren- 
dition. On the other hand, the error diffusion method is 
slow in the processing speed but superior in the tonal 
rendition, thus providing a wider color reproduction 
range. 

Thus the dither method and the error diffusion meth- 
od are different in the color reproduction range. 

Output profile setting/reading means 5 sets and 
reads the output profile, according to the printer condition 
set by the printer condition setting means 9. 

Output profile memory means 7 stores the output 
profile representing the device characteristics of the re- 
cording device connected to the present system, and 
said profile data contain, like the input profile data, the 
color coordinates of a white point and red, green and blue 
primay colors, response curves for different colors, a 
look-up table (LUT) for conversion from L*a*b* values 
specific to the output profile data to device-dependent C, 
M, Y, K values, and an LUT for confirming the color re- 
production range of the device from the L*a*b* values. 
These tables contain data for all the combinations of the 
recording devices and the binarizing methods. 

Monitor output RGB calculation means 1 3 calcu- 
lates the R, G, B values released to the monitor 10, 
based on the input R, G, B values dependent on the mon- 
itor 1 0 and the output of the color reproduction range cal- 
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culation means 1 . If the considered R. G, B values are 
identified by the color reproduction range calculation 
means 1 as within the color reproduction range of the 
output device, the R, G, B values are supplied to the 
monitor 1 0 without change. On the other hand, if outside 
the color reproduction range, the R, G, B values are con- 
verted to 1, 1, 1 and supplied to the monitor 10 for dis- 
playing a white blank area thereon, as an alarm to the 
operator. 

In the present invention, such alarm to the operator 
is not limited to the above-explained method but can be 
given, for example, by a black display area or by an 
acoustic signal. 

Now there will be explained, with reference to a flow 
chart shown in Fig. 3, the conversion executed in the 
color space conversion means 2 from the R, G, B values 
in the input device space, dependent on the monitor 10, 
to the C, M, Y. K values in the output device space. Said 
conversion is executed in the following four processes, 
based on the parameters of the set printer profile: 

(1) RGB — » R'G'B' 

A 1 st step convert the input device-dependent 
RGB values into corrected values, based on re- 
sponse curves: 

R* = response R (R) 
G' = response G (G) 
B' = response B (B) 
wherein response R, response G and response B 
are functions representing the gamma characteris- 
tics of the monitor contained in the input profile, and 
the values R\ G\ B' representing the colors dis- 
played on the monitor are obtained by applying 
these functions to the R, G, B values in the input de- 
vice space. 

This 1st step can achieve precise conversions 
by simple calculations. 

(2) R'G'B' -> XYZ 

A 2nd step converts the R', G\ B* values into 
values in the XYZ color space as follows: 
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wherein nine parameters Rx, Ry, Rz, Gx, Gy, Gz, 
55 Bx, By and Bz are determinable from the color co- 
ordinates of red, green and blue phosphors and the 
color coordinate of the white point of the monitor, 
contained in the monitor profile, and can be deter- 



4 



7 



EP 0 706 285 A2 



8 



mined, based on these color coordinates (x Rl y R> 

z R ). (x g . ye. z g). (*b. v b. 7 -b) and ( y w. yw. *w) b y 

solving the following nine simultaneous equations: 
Gx x x R + Gy x y R + Gz x z R = 0 
Bx x x R + By x y R + Bz x z R = 0 
Rx x x G + Ry x y G + Rz x z G = 0 
Bx x x G + By x y G + Bz x z 6 = 0 
Rx x x B + Ry x y B + Rz x z B = 0 
Gx X x B + Gy X y B + Gz X z B = 0 
Rxxx w + Ryxy w + Rzxz w =l 
Gx X x w + Gy X y w + Gz x z w = 1 
Bx x x w + By x y w + Bz x z w = 1 
The conversion Irom R\ G\ B' to XYZ system is con- 
ducted by an inverse matrix of a 3x3 matrix having 
these nine parameters as the components thereol. 
It the white point in the monitor profile is different 
from that of the printer profile, there may be conduct- 
ed white point scaling, for example, according to the 
coefficient rule of von Kries (J. von Kries: Die Gesi- 
chisempfindungen In W. Nagel (ed.). Handb. physi- 
ol. Menschens. Vol. 3, Braunschweig: Vieweg, 
pp. 109-282 (1905)). 

Such correction of the white point of the monitor 
according to that of the printer enables precise con- 
version. 

(3) XYZ -> L*a*b* 

A 3rd step converts the value in the XYZ color 
space into a value in a uniform L*a*b* color space 
in the following manner: 
If Y/Yw>0.008856, 

L* = 116x(Y/Yw) l/3 -16; 
if Y/YwSO.008856, 

L* = 903.29X(Y/Yw) 
if X/Xw>0. 008856, 

Y/Yw>0. 008856 , and 
Z/Zw>0.008856, 
a* = 500X[(X/Xw) 1/3 -(Y/Yw) 1/3 ] 
b* = 200x[(Y/Yw) 1/3 -(Z/Zw) 1/3 ]. 
In other cases, the foregoing cubic root terms 
are respectively replaced by: 
7.787 X (X/Xw) + 16/116, 
7.787 X (Y/Yw) + 16/116, 
7.787 X (Z/Zw) + 16/116 

(4) L*a*b* -» YMCK 

A 4th step converts the value in the uniform 
L*a*b* color space into C, M, Y, K values dependent 
on the output device, or printer 11 as follows: 

C=LUT C [L* a* b*] 

M=LUT M [L* a* b*] 

Y=LUT Y [L* a* b*] 

K=LUT K [L* a* b*] 
wherein LUT C , LUT M , LUT Y and LUT K are three-di- 
mensional look-up tables with input of L*a*b* and re- 
spective outputs of C, M, Y and K. These tables are 
prepared in advance by measuring color patches re- 
corded in the recording device based on the C, M, 



Y, K values reproducible in the binarizing method 
and placing the C, M, Y, K values of said color patch- 
es on the lattice points of the corresponding LUT. 
based on thus obtained combinations of the L*a*b* 
s values and the C, M, Y, K values. 

As each lattice point of the LUT does not necessarily 
have a measured set of C, M, Y, K values, a closest set 
of measured values within a predetermined range may 

io be adopted for the lattice point. Though it is desirable to 
prepare these tables by effecting color measurements 
for all the combinations of C, M, Y and K, such combina- 
tions will require 2 32 = 4,294,697,296 color measure- 
ments in case each of C, M, Y and K is represented by 

is 8 bits, so that these tables may in practice be prepared 
by interpolating the results of about 4,096 color meas- 
urements. 

Also as the color reproduction range of the printer is 
generally narrower than that of other image output de- 

20 vices such as a monitor printer, there may result a case 
where the input image data are outside the color repro- 
duction range of the recording device so that the lattice 
point of the above-mentioned LUT lacks the correspond- 
ing color measurement data Consequently the LUT's 

25 may be prepared by a color space compression for map- 
ping the input pixel outside said color reproduction range 
into the color reproduction range of the recording device. 

Such mapping can be achieved, for example, for re- 
taining the brightness without change in the hue, by 

30 maintaining L* constant and a*/b* ratio constant, and tak- 
ing C, M, Y, K values within the color reproduction range, 
farthest from the L* axis, as the values on said lattice 
point. However the mapping method is not limited to such 
example. 

35 In this manner the monitor-dependent R, G, B values 
are converted into the C, M, Y, K values for the recording 
device, and thus converted C, M, Y, K values are sup- 
plied to the recording device currently connected to the 
system, whereby a color approximately coinciding with 

40 the color displayed on the monitor can be recorded by 
the recording device. 

However, if such color space compression is con- 
ducted, the color of at least the pixel outside the color 
reproduction range cannot be faithfully reproduced by 

45 the recording device. It is therefore necessary for the op- 
erator to recognize the pixels outside the color reproduc- 
tion range; as inlormed by the color reproduction range 
calculation means 1 and todecide whether to effect color 
space compression before data supply to the recording 

so device or to switch to another recording device showing 
fewer pixels outside the color reproduction range. 

In the following there will be explained, with refer- 
ence to a flow chart shown in Fig. 4, a method to be ex- 
ecuted in the color reproduction range calculation means 

ss 2 for determining whether the R, G, B values in the input 
device space are reproducible by the output device. 

In Fig. 4, steps same as those in Fig. 3 are repre- 
sented by same numbers. 
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The above-mentioned calculation method is execut- 
ed through the following four processes, utilizing the pa- 
rameters in the set printer profile: 

(1) RGB — » R'G'B* 

This conversion is same as the 1 st step execut- 
ed by the color space conversion means 1 . 

(2) R'G'B' -> XYZ 

This conversion is same as the 2nd step exe- 
cuted by the color space conversion means 1 . 

(3) XYZ -> L*a*b* 

This conversion is same as the 3rd step execut- 
ed by the color space conversion means 1 . 

(4) L*a*b*-» 1/0 

A 4th step discriminates whether the input im- 
age data are within the color reproduction range of 
the output device, based on the L*a*b* representing 
said input image data: 

1/0 = LUT g [L*a*b*] 
wherein LUT g is a three-dimensional look-up table with 
the input L*a*b* and an output 1 (reproducible)/0 (not re- 
producible), and is present in the printer profile set by the 
output profile setting/reading means 5. 

This LUT is prepared by measuring in advance com- 
binations of the C, M, Y, K values reproducible in the re- 
cording device according to the binarizing method, and 
placing 1 or 0 respectively if a corresponding lattice point 
of the LUT is present or absent. As in the LUT C , LUT M , 
LUT Y and LUT K used in the 4th step, it is desirable to 
use the data measured for ail the combinations of the C, 
M, Y, K values, but this table may be formed by interpo- 
lating the results of about 4,096 color measurements. 
Thus there can be calculated whether the monitor-de- 
pendent R\ G\ B 1 values are reproducible by the record- 
ing device currently connected to the system, and the 
result is supplied to the monitor output RGB calculation 
means 13 whereby the pixel positions within the color 
reproduction range can be displayed on the monitor. 

Also, as the output profile or the printer profile is set 
according to the kind of the printer and the binarizing 
method adopted therein, the color processing can be 
achieved based on the parameters faithful to the char- 
acteristics of the output device. 

[Embodiment 1 -2] 

Fig. 5 is a block diagram showing an image process- 
ing apparatus constituting a variation 1 of the 1 st embod- 
iment, wherein components same as those in Fig. 2 are 
represented by same symbols and will not be explained 
further. 

In the present embodiment, different from the con- 
figuration of the 1st embodiment, gamma value setting 
means 21 for setting the gamma value of the monitor is 



connected to the input profile setting/readingA/arying 
means 3 whereby a monitor profile 1 2 is set correspond- 
ing to each monitor. Also density/balance setting 20 for 
setting the density of the output image and the balance 
s of C, M, Y and K inks is connected to the output profile 
setting/reading/varying means 25, whereby a printer pro- 
file 14 is set for each recording device. Such configura- 
tion allows to vary the response curve of the profile data 
according to the gamma value of the currently set mon- 
10 itor and also according to the current set density and bal- 
ance thereof. Thus, according to the present embodi- 
ment, the color formed on the printer can be made to 
exactly coincide with the color on the monitor, based on 
the gamma value of the monitor condition and the den- 
75 sity/balance value of the printer condition. 

[Embodiment 1 -3] 

Fig. 6 is a block diagram showing an image process- 
20 ing apparatus constituting a variation 2 of the 1 si embod- 
iment, wherein components same as those in Fig. 2 are 
represented by same symbols and will not be explained 
further. 

In the present embodiment, in addition to the con- 
2£ figuration of the 1st embodiment, recording medium set- 
ting means 60 is connected to the output profile set- 
ting/reading means. Such configuration allows to select 
appropriate profile data in consideration not only of bina- 
rizing method in the recording device but also of the dif- 
30 f erence in the color reproduction range resulting from the 
difference in the recording medium, whereby the color 
formed in the printer can be made to more exactly coin- 
cide with the color on the monitor. 

The recording medium is the material on which im- 
35 age is recorded by the recording device, and can be, for 
example, coated paper, plain paper, OHP sheet, BPF 
sheet or lustre paper. The features of these recording 
media will be briefly explained in the following. 

The coated paper, BPF sheet and lustre paper have 
40 a wide color reproduction range, but the plain paper and 
BJ cloth have a narrow range. The OHP sheet has a wide 
range as the colors are represented by the transmissive 
light. 

In this manner, the color reproduction range varies 
45 depending on the recording medium. 

[Embodiment 1-4] 

Fig. 7 is a block diagram showing an image process- 
so ing apparatus constituting a variation 3 of the 1 st embod- 
iment, wherein components same as those in Fig. 2 are 
represented by same symbols and will not be explained 
further. 

I In the present embodiment, in addition to the output 

55 profile memory means 7 of the 1 st embodiment, there is 
provided preview profile memory means 71 for storing 
I profile data for preview. Such preview profile allows, 

i when a preview mode is turned on, to preview, on the 
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monitor, the color based on the image data subjected to 
color space compression, namely the color actually ob- 
tained on the recording device from the image data not 
reproducible thereon. It is thus rendered possible to con- 
firm the result of the color space compression. Different 
trom the output profile data the preview profile data con- 
tain a look-up table for color space compression from 
L*a*b* values to L*a*b* values, instead of the look-up ta- 
ble for conversion from the L*a*b* values to the de- 
vice-dependent C, M, Y, K values. Thus the R, G, B val- 
ues entered into the color space conversion means 2 are 
converted, by the steps (1) to (3) explained in the 1st 
embodiment, into L*a*b* values, then further converted 
in the step (4) into L/'a^b*' values, and are subjected to 
inverse conversions of the steps (1 ) to (3) to the R, G, B 
values, which are used for display on the monitor. Such 
configuration allows to display, on the monitor in ad- 
vance, the difference in the color reproduction range or 
in the output tonal characteristics resulting from the dif- 
ference in the binarizing method. 

Thus, in an image processing system in which the 
profile data representing the characteristics of the in- 
put/output devices are set corresponding to the in- 
put/output devices used in the system, and the R, G, B 
values defined in the color space of the input device are 
converted into the C, M, Y, K values of the color space 
of the output device by reading thus set input/output pro- 
files, whereby the color desired by the operator on the 
input device is exactly reproduced on the output device 
or the C, M, Y, K values are reconverted to the R, G, B 
values in the color space of the input device for preview- 
ing on the monitor, it is rendered possible to exactly re- 
produce the desired color and to achieve previewing on 
the monitor even in the presence of variation in the bina- 
rizing method, recording medi um and various set values. 

[Embodiment 1 -5] 

Fig. 8 is a block diagram showing an image process- 
ing apparatus constituting a variation 4 of the 1 st embod- 
iment, wherein components same as those in Fig. 2 are 
represented by same symbols and will not be explained 
further. 

In the 1st embodiment, the R, G, B image data en- 
tered into the host equipment are dependent on the mon- 
itor. 

In the image processing apparatus of the present 
embodiment, the input image data are XYZ values not 
dependent on the device. 

Input means 81 enters XYZ values, independent on 
the device, from an external equipment. RGB calculation 
means 82 converts the XYZ values, entered by the input 
means and not dependent on the device, into RGB val- 
ues dependent on the monitor 10, based on the input 
profile representing the characteristics of the monitor 1 0. 

The present embodiment is featured by the conver- 
sion of the input XYZ values, not dependent on the de- 
vice, into the monitor-dependent RGB values. 



Such conversion into the image data of desired char- 
act eristics constituting a reference in the image process- 
ing apparatus, based on the input profile representing 
the characteristics of the input image data entered by the 

5 input means, allows to faithfully reproduce the color of 
the input image data on the monitor and on the printer. 

Thus, in an image processing system in which plural 
sets of profile data corresponding to various settings of 
the input and output devices are set, and which is pro- 

io vided with input/output profile setting/reading means for 
reading out a profile according to the kind of the devices, 
settings there of and setting of the process mode, and 
color space conversion means capable of varying the 
processing method according to various settings or the 

75 process mode, thereby converting the color values de- 
fined in the color space of the input device into those of 
the color space of the output device, it is rendered pos- 
sible to exactly reproduce the color even in the presence 
of variations in various settings. 

20 in the foregoing 1 st embodiment, the gamma value 
is set for the input device, and the binarizing method, re- 
cording medium, preview mode, density and color bal- 
ance are set for the output device, but other setting con- 
ditions may naturally be added to the profile data. 

2B Also the 1st embodiment employs a binarization 
process, but the present invention is not limited to such 
case and is applicable to any digitization process to n 
values, wherein n is a natural number smaller than the 
number m of levels of the input R, G, B values. 

30 

[2nd embodiment] 

The foregoing 1st embodiment described a system 
for faithfully reproducing, on the printer, an image pre- 
35 pared by an application task on the host equipment. 

The 2nd embodiment describes a system for prepar- 
ing an image by an application task, utilizing color sam- 
ples. 

The present 2nd embodiment is also applicable, like 
40 the foregoing variations, to the 1st embodiment. 

Fig. 9 is a block diagram showing an image process- 
ing system constituting a 2nd embodiment of the present 
invention. 

A color sample book 101 consists of color samples 
45 prepared in advance by a recording device (not shown) 
connected to the system or an ordinary printing press, 
and is utilized as reference by the operator, in determin- 
ing the color to be released by the recording device con- 
nected to the system. A monitor 1 02 displays color sam- 
so pies in a similar manner as the color sample book 1 01 , 
whereby the operator can set the color to be formed in 
the recording device in interactive manner. Recording 
means 103 records the color coordinates of each color 
sample, registered in the color sample book 101, in the 
55 CIE La*b* space in association with an index number, for 
all the colors contained in the color sample book 101. 
Though the color coordinates of each sample color are 
recorded, in the present embodiment, in the CIE La*b* 
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space, but such recording may be made in any device-in- 
dependent color space such as CIE XYZ space or CIE 
Lu*v* space. In any color space other than the CIE XYZ 
space, there are also required the color coordinates, in 
the CI E XYZ space, of the white point in said color space, s 
so that such coordinates are also recorded. 

There are also provided input profile memory means 
104 for storing monitor profile data, representing the de- 
vice characteristics of a monitor connected to the present 
system, and output profile memory means 1 05 for storing to 
profile data, representing the device characteristics of a 
recording device connected to said system. Each of 
these profile data contains the color coordinates of the 
white point and red, green and blue primary colors, and 
the response curves for these colors. 75 

Also the printer profile contains a look-up table (LUT) 
for conversion from the L*a*b* values, not dependent on 
the device, to the device-dependent C, M, Y, K values 
and an LUT for confirming the color reproduction range 
of the device from the L*a*b* values. 20 

Consequently the RGB data, dependent on the de- 
vice characteristics of the monitor, can be converted into 
the monitor-independent data, based on the data corre- 
sponding to said monitor in the monitor profile. Also the 
L*a*b* data, independent of the device and obtained 2S 
from the color sample book, can be converted into the 
monitor-dependent RGB data, based on the data of the 
above-mentioned monitor profile. Consequently the im- 
age on the monitor can be displayed with a faithful color. 

Similarly, in case of data supply to the recording de- 30 
vice, the device-independent image data can be convert- 
ed into the recording device-dependent C, M, Y, K data, 
based on the data in the printer profile corresponding to 
said recording device. Thus a faithful color can be repro- 
duced on the recording device. 35 

Input profile setting means 106 and output profile 
setting means 107, for respectively setting a monitor pro- 
file and a printer profile, are adapted to select profile da- 
ta, matching the monitor and the printer currently con- 
nected to the system, from plural sets of profile data *o 
stored in the above-mentioned memory means, accord- 
ing to the information supplied to the setting means and 
indicating the kind of the monitor and the recording de- 
vice. Sample color setting means 108 sets, with an index 
number, a color selected by the operator from the sample 4 & 
colors on the monitor. Reading means 109, for reading, 
from recording means 103, the color coordinate values 
corresponding to the sample color set by the sample 
color setting means 108, reads the color coordinate val- 
ues of the sample color from the recording means 103, so 
according to the corresponding index number released 
from the sample color setting means 108. Calculation 
means 110, for calculating the R, G, B values to be dis- 
played on the monitor, effects said calculation from the 
set monitor profile and the color coordinates of the sam- 55 
pie color read by the reading means 109, based on the 
information indicating the kind of monitor, from the input 
profile setting means 106. The conversion from the color 



coordinates L*a*b* of the sample color to the monitor-de- 
pendent R\ G\ B* values is executed in the following 
three steps: 

(1) L*a*b* — > XYZ 
A 1 st step converts the L*a*b* color space into 

XYZ space according to the following equations: 
X = Xw x g ((L* + 16)/116 + aV500) 
Y = Yw X g((L* + 16)/116) 
Z = Zw X g ((L* + 16)/116 - b*/200) 
wherein Xw, Yw, Zw are color coordinates of the 
white point used in the measurement of the sample 
color, and function g(x) is: 
g(x) - x 3 for x ^ 6/29; 
g(x) = (108/841) X (x - (4/29)) for x < 6/29. 

(2) XYZ ^ RGB 
A 2nd step converts the XYZ color space into 

RGB space based on the color coordinates of R, G, 
B phosphors of the monitor and of the white point, 
according to the following equations: 
R = RxxX + RyXY + RzXZ 
G = GxxX + GyXY + GzxZ 
B = BxxX + ByxY + BzxZ 
wherein nine parameters Rx, Ry, Rz, Gx, Gy, Gz, 
Bx, By and Bz are determinable from the color co- 
ordinates of red, green and blue phosphors and the 
color coordinates of the white point of the monitor, 
contained in the monitor profile.and can be deter- 
mined, based on these color coordinates (x R , y R , 

Zr). (x g . Vg> z G ), (x b . YB. Zb) a nd (*w. y w . z w )» by 
solving the following nine simultaneous equations: 
Gx X x R + Gy x y R + Gz x z R = 0 
Bx x x R + By x y R + Bz x z R = 0 
Rx x x G + Ry X y G + Rz X z G = 0 
Bx x x G + By x y G + Bz x z G = 0 
Rx x x B + Ry x y B + Rz x z B = 0 
Gx x x B + Gy x y B + Gz x z B = 0 
Rx x x w + Ry x y w + Rz x z w = 1 
Gx x x w + Gy x y w + Gz x z w = 1 
Bx x x w + By X y w + Bz x z w = 1 

(3) RGB -» R'G'B' 
A 3rd step corrects the RGB values, obtained in 

the 2nd steps, according to response curves in the 
following manner: 

R' = response R" 1 (R) 
G' = response G- 1 (G) 
B* = response B~ 1 (B) 
wherein response R, response G and response B 
are functions representing the gamma characteris- 
tics of the monitor contained in the monitor profile. 
For faithful reproduction of the colors, the inverse 
functions of these functions are applied to the R, G, 
B values determined in the step (2) to obtain moni- 
tor-dependent R'G'B' values, or the RGB values to 
be displayed on the monitor. 
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In this manner there is executed the conversion from 
the color coordinates L*a*b* ot the sample color to the 
monitor-dependent R'G'B' values. If the white point used 
in the measurement ot the sample color recorded by 
three recording means is different from the white point ^ 
ot the monitor in the monitor profile, there may be con- 
ducted white point scaling, for example, according to the 
coefficient rule of von Kries (J. von Kries: Die Gesich- 
tsempfindungen In W. Nagel (ed.), Handb. Physiol. Men- 
schens, Vol. 3, Braunschweig: Vieweg, pp. 109 - 282 * 
(1905)). 

The FT. G\ B' values calculated by the calculation 
means 110 are supplied to the monitor, whereby a color 
same as the sample color in the color sample book 101 
is displayed on the monitor 102. 

Even when the monitor connected to the system is 
changed, a monitor profile corresponding to the kind of 
thus changed monitor can be set by the input profile set- 
ting means 106, so that plural monitors can be handled 
with a simple configuration. 

CMYK calculation means 111 calculates the C, M, 
Y, K values dependent on the recording device to be 
used among those currently connected to the system, 
utilizing the monitor-dependent R, G, B values calculated 
by the calculation means 110 and the printer profile set 
by the output profile setting means 107 according to the 
information indicating the kind of the recording device. 
The conversion from the monitor-dependent FT, G', B' 
values to the recording device-dependent C, M, Y, K val- 
ues is executed in the following four steps: 

(1) R'G'B' — » RGB 

A 1 st step is an inverse conversion of the step 
(3) of the RGB calculation means 110. 

(2) RGB -> XYZ 

This is also an inverse conversion of the step 

(2) of the RGB calculation means 110. Also in this 
case, if the white point in the monitor profile is differ- 
ent from that in the printer profile, a correction may 
be made for example according to the coefficient 
rule of von kries. 

(3) XYZ -> L*a*b* 

This is also an inverse conversion of the step 
(1 ) of the RGB calculation means 1 1 0, conducted in 
the following manner: 

if Y/Yw>0.008856, 

|_*= i16x(Y/Yw) l/3 -16; 
if Y/Yw^O.008856, 

L* = 903.29x(Y/Yw) 
if X/Xw>0.008856, 

Y/Yw>0.008856, and 
Z/Zw>0.008856, 
a* = 500x[(X/Xw) 1/3 -(Y/Yw) 1/3 ] 
b* = 200X[(Y/Yw) 1/3 -(Z/Zw) 1/3 ]. 
In other cases, the foregoing cubic root terms 
are respectively replaced by: 



7.787 X (X/Xw) + 16/116. 
7.787 X (Y/Yw) + 16/116, 
7.787 X (Z/Zw) + 16/116, 

(4) L*a*b* -> CMYK 

C = LUT C [L\ a*, b*l 
M = LUT M [L*. a*, b*] 
Y = LUT Y [L*, a*,b*] 
K = LUT K [L*. a*, b*] 
wherein LUT C , LUT M , LUT Y and LUT K are 
three-dimensional look-up tables with input of L*a*b* 
and respective outputs of C, M, Y, K dependent on 
the recording device. These tables are prepared in 
advance by measuring colors recorded in the com- 
binations of C, M, Y, K values reproducible by the 
recording device, and placing the C, M, Y, K values 
of said colors on the lattice points of the correspond- 
ing LUT. As each lattice point ot the LUT does not 
necessarily have a measured set of C, M, Y, K val- 
ues, a closest set of measured values within a pre- 
determined range may be adopted for the lattice 
point. Though it is desirable to prepare these tables 
by effecting color measurements for all the combi- 
nations of C, M, Y and K, such combinations will 
require 2 32 = 4,294,697,296 color measurements in 
case each of C, M, Y and K is represented by 8 bits, 
so that these tables may in practice be prepared by 
interpolating the results of about 4,096 color meas- 
urements. In case any lattice point of the LUT lacks 
the corresponding data of color measurement, 
namely if the color coordinates of said lattice point 
is outside the color reproduction range of the record- 
ing device, suitable C, M, Y, K values may be 
assigned by a suitable mapping. Such mapping can 
be achieved, for example, for retaining the bright- 
ness without change in the hue, by maintaining L* 
constant and a*/b* ratio constant, and taking C, M, 
Y, K values within the color reproduction range, far- 
thest from the L* axis, as the values on said lattice 
point. However the mapping method is not limited to 
such example. 

In this manner the monitor-dependent R\ G\ B' val- 
ues are converted into the recording device-dependent 
C, M, Y, K values, which are supplied to the recording 
device currently connected to the system. It is thus ren- 
dered possible to record, by the recording device, a color 
same as or closest within the reproducible range to the 
sample color set on the monitor 1 02 by the operator with 
reference to the color sample book 101 . 

As in the case of monitor, the output profile setting 
means 107 can vary the printer profile according to the 
kind of the printer, so that any recording device connect- 
ed to the system can be easily handled. 

Color reproduction range calculation means 1 1 2 cal- 
culates whether the set sample color is reproducible by 
the recording device currently connected to the system, 
based on the R, G, B values calculated by the calculation 



9 



17 



EP 0 706 285 A2 



18 



means 1 1 0 and the printer profile set by the output profile 
setting means 107. Said calculation is executed in the 
following four steps: 

(1) R'G'B'-^ RGB 

This step is same as the step (1) of the CMYK 
calculation means 111. 

(2) RGB-* XYZ 

This step is also same as the step (2) of the 
CMYK calculation means 111. If the white point in 
the monitor profile is different from that in the printer 
profile, there may be conducted a correction for ex- 
ample according to the coefficient rule of von Kries. 

(3) XYZ -* L*a*b* 

This step is same as the step (3) of the CMYK 
calculation means 111: 
if Y/Yw>0. 008856, 

L*= 116x(Y/Yw) 1/3 -16; 
if Y/Yw^0.008856, 

L* = 903.29X(Y/Yw) 
if X/Xw>0. 008856, 

Y/Yw>0.008856, and 
Z/Zw>0.008856, 
a* = 500X[(X/Xw) 1/3 -(Y/Yw) 1/3 ] 
b* = 200x[(Y/Yw) 1/3 -(Z/Zw) 1/3 ]. 
In other cases, the foregoing cubic root terms 
are respectively replaced by: 

7.787 X (X/Xw) + 16/116, 
7.787 X(Y/Yw) + 16/116, 
7.787 X (Z/Zw)+ 16/116 

(4) L*a*b*-» 1/0 

C = LUT g [L*, a*, b*] 
wherein LUT g is a three-dimensional look-up table 
with the input of L*a*b* and an output 1 (reproduci- 
ble)/0 (not reproducible), and is prepared by meas- 
uring in advance combinations of the C, M, Y, K val- 
ues reproducible in the recording device and placing 
1 or 0 respectively if a corresponding lattice point of 
the LUT is present or absent. As in the case of LUT C> 
LUT M , LUT Y and LUT K> it is desirable to use the data 
measured tor all the combinations of the C, M, Y, K 
values, but this table may be formed by interpolating 
the results of about 4,096 color measurements. 

Thus there can be calculated whether the moni- 
tor-dependent R\ G\ B' values are reproducible by the 
recording device currently connected to the system, and 
the result is supplied to the monitor 101 for display ther- 
eon or acoustic output means (not shown) for generating 
an alarm sound to the operator. 

[Embodiment 2-2] 

Fig. 10 is a block diagram showing an image 
processing apparatus constituting a variation 1 of the 



2nd embodiment, wherein components same as those 
in Fig. 9 are represented by same symbols and will not 
be explained further. 

In the present embodiment, the CMYK calculation 

5 means 113 and the color reproduction range calculation 
means 114 effect calculation of the C, M, Y, K values to 
be used in the recording device currently connected to 
the system and calculation whether the color is repro- 
ducible by the recording device currently connected to 

10 the system, utilizing the L*. a*, b* values released from 
the reading means 109 and the printer profile set by the 
output profile setting means 107. In the present embod- 
iment, the direct calculation with the L*, a*, b* values re- 
leased from the reading means 109 allows to dispense 

is with a series of conversions of R'G'B' -> RGB XYZ -> 
L*a*b* as in the 1st embodiment, thereby achieving a 
better efficiency in the system. 

[Embodiment 2-3] 

20 

Fig. 11 is a block diagram of an image processing 
apparatus constituting a variation 2 of the 2nd embodi- 
ment of the present invention, wherein components 
same as those in Fig. 9 are represented by same sym- 
2S bols and will not be explained further. 

In the present embodiment, the operator sets, by the 
monitor 102, the color coordinates of a desired color in 
the device-independent color space, instead of the index 
number in the color sample book. The color sample book 
30 116 contains sample colors and color coordinate values 
thereof, and the operator directly enters said coordinate 
values by the sample color setting means 115. Such con- 
figuration allows to dispense with the recording means 
103 and the reading means 109, thereby achieving a 
35 simpler system. 

As explained in the foregoing, in a system in which 
color designation is conducted with a color sample book 
allowing to predict the colors reproducible by the record- 
ing device, the 2nd embodiment of he present invention 
40 enables to reproduce the exact color not only on the 
monitor but also on the recording device, and to check, 
in advance, whether the designated color is within the 
color reproduction range of the recording device. 

The foregoing embodiments utilize the CIE La*b* 
45 space as the device-independent color space, but there 
may employed the CIE XYZ space or CIE Lu*v* space 
as long as device-independent description is possible. 
Also in the foregoing embodiments, four colors of C, M, 
Y and K are assumed for supply to the recording device, 
50 but a similar configuration is naturally possible with three 
colors of R, G and B or C, M and Y or with a larger number 
of colors. 

Also the recording device employed in the present 
invention is not limited to the one explained in the fore- 
55 going, but there may be employed a recording device 
provided with a recording head for discharging liquid 
droplets by film boiling with thermal energy and employ- 
ing a recording method utilizing such recording head. 
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The present invention is furthermore applicable to a 
case in which the present invention is realized by the 
supply ot a program to a system or an apparatus. In such 
case a recording medium storing the program o1 the 
' present invention constitutes the present invention. Said 5 
program is to control the process ot the various means, 
and the system or the apparatus functions in a predeter- 
mined manner by the supply of said program from said 
memory medium to said system or the apparatus. 

The present invention is not limited to the foregoing 10 
embodiments but is subject to various modifications 
within the scope and spirit of the appended claims. 



Claims 75 

1 . An image processing method comprising steps ot: 

entering information on a signal processing 
condition in predetermined output means; and 

mapping color image data within a color repro- 20 
duction range reproducible by said predetermined 
output means under said entered signal processing 
condition. 

2. A method according to claim 1 , further comprising a 2s 
step of storing plural sets of data based on the char- 
acteristics under said output condition, correspond- 
ing to various output conditions of predetermined 
output means. 

30 

3. A method according to claim 1 , wherein said output 
conditions of the predetermined output means are 
related to an n-level digitizing process. 

4. A method according to claim 1 , wherein said signal 35 
processing condition of the predetermined output 
means is related to image density or color balance. 

5. A method according to claim 1, which comprises 
entering information on said signal processing con- 40 
dition of the predetermined output means and infor- 
mation on recording medium. 

6. A method according to claim 1 , wherein said map- 
ping is executed with color space compression. 

7. An image processing method for discriminating 
whether input image data are within a color repro- 
duction range of predetermined output means, 
wherein said discrimination is executed, based on a 
color reproduction range corresponding to an output 
condition of said predetermined output means. 

8. A method according to claim 7, wherein said output 
condition of the predetermined output means is ss 
related to a binarizing process. 

9. A method according to claim 7, wherein said output 



condition of the predetermined output means is 
related to image density or color balance. 

10. A method according to claim 7, wherein said output 
condition of the predetermined output means is 
related to a recording medium. 

11. An image. processing apparatus comprising: 

first input means for entering color image data 
dependent on the characteristics of a predetermined 
device; 

first memory means for storing input profile 
data representing the characteristics of said prede- 
termined device; 

second memory means for storing output pro- 
file data representing of predetermined image 
recording means under output conditions; 

second input means lor entering information 
representing the output condition of said image 
recording means; and 

color space conversion means for effecting 
color space conversion on the color image data 
entered by said first input means, based on said 
input profile data and said output profile data stored 
in said second memory means and corresponding 
to the output condition of the image recording means 
entered by said second input means. 

12. An apparatus according to claim 11, wherein said 
output conditions of the image recording means are 
related to a binarizing process. 

13. An apparatus according to claim 11, wherein said 
output conditions of the image recording means are 
settings related to image density or color balance. 

14. An apparatus according to claim 11, wherein said 
output conditions of the image recording means are 
related to the recording medium. 

15. An apparatus according to claim 11, wherein the out- 
put profile data stored in said second memory 
means correspond to the kind ol the image recording 
means. 

16. An apparatus according to claim 11, wherein the 
input profile data stored in said first memory means 
and representing the characteristics of the predeter- 
mined device correspond to output conditions of 
said predetermined device. 

17. An apparatus according to claim 11, wherein said 
predetermined device is a display device. 

18. An apparatus according to claim 17, wherein said 
output conditions of the display device are settings 
related to the gamma value. 
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19. An image processing apparatus provided with: 

input means tor entering color designation 
information; 

first memory means for storing color data; 
second memory means for storing data repre- 5 
senting the characteristics of display means; and 
third memory means for storing the character- 
. istics of recording means for recording an image on 
a recording medium; said apparatus comprising: 

reading means for reading the color data cor- to 
responding to said color designation information 
entered by said input means; 

color space conversion means for effecting 
color space conversion of the color data, read by 
said reading means, into color data matching the 
characteristics of said recording means, based on 
the data stored in said second memory means and 
representingthedisplay characteristics and the data 
stored in said third memory means and representing 
the characteristics of the recording means; and 

output means for supplying the color data, 
subjected to the color space conversion by said 
color space conversion means, to said recording 
means. 
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20. An apparatus according to claim 19, wherein the 
color data stored in said first memory means are 
color data in a device-independent color space. 

21. An apparatus according to claim 19, wherein said 
color space is a uniform color space. 

22. An image processing method comprising steps of: 

entering color designation information; 

storing color data; 

storing data representing the characteristics of 
display means; 

storing the characteristics of recording means 
for recording an image on a recording medium; 

reading color data corresponding to said «o 
entered color designation information; 

effecting color space conversion on said read 
color data into color data matching the characteris- 
tics of said recording means, based on said stored 
data representing the display characteristics and 
said stored data representing the characteristics of 
the recording means; and 

sending said color data, subjected to said color 
space conversion, to said recording means. 

23. Apparatus for reproducing color data in which color 
space conversion is carried out on the color data, 
and means are provided for varying the manner in 
which the color space conversion is carried out in 
accordance with the nature of the output apparatus 
which is to reproduce the converted color data. 
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